Time-Inconsistent Discrete-Time Stochastic Linear-Quadratic Optimal Control: Time-consistent Solutions
نویسندگان
چکیده
In this paper, the time-consistent solutions of a timeinconsistent discrete-time stochastic linear-quadratic optimal control are investigated. Different from the existing literature, the definiteness constraint is not posed on the state and the control weight matrices of the cost functional. Necessary and sufficient conditions are, respectively, obtained to the existence of the open-loop time-consistent equilibrium control and the closedloop time-consistent equilibrium strategy, which contain the solvability of certain system of forward-backward stochastic difference equations, the stationary conditions and the convexity conditions. Furthermore, for the case that the system matrices are independent of the initial time, the existence of the openloop equilibrium pair for all the initial pairs is shown to be equivalent to the solvability of a system of generalized difference Riccati equations and a system of linear difference equations. Moreover, the existence of the closed-loop equilibrium strategy is shown to be equivalent to the solvability of another system of generalized difference Riccati equations. Interestingly, if solvable, the system of generalized difference Riccati equations for the open-loop formulation does not admit symmetric solution, while the one for the closed-loop formulation has symmetric solution.
منابع مشابه
Optimal discrete-time control of robot manipulators in repetitive tasks
Optimal discrete-time control of linear systems has been presented already. There are some difficulties to design an optimal discrete-time control of robot manipulator since the robot manipulator is highly nonlinear and uncertain. This paper presents a novel robust optimal discrete-time control of electrically driven robot manipulators for performing repetitive tasks. The robot performs repetit...
متن کاملDiscrete-time repetitive optimal control: Robotic manipulators
This paper proposes a discrete-time repetitive optimal control of electrically driven robotic manipulators using an uncertainty estimator. The proposed control method can be used for performing repetitive motion, which covers many industrial applications of robotic manipulators. This kind of control law is in the class of torque-based control in which the joint torques are generated by permanen...
متن کاملOptimal Finite-time Control of Positive Linear Discrete-time Systems
This paper considers solving optimization problem for linear discrete time systems such that closed-loop discrete-time system is positive (i.e., all of its state variables have non-negative values) and also finite-time stable. For this purpose, by considering a quadratic cost function, an optimal controller is designed such that in addition to minimizing the cost function, the positivity proper...
متن کاملHaar Matrix Equations for Solving Time-Variant Linear-Quadratic Optimal Control Problems
In this paper, Haar wavelets are performed for solving continuous time-variant linear-quadratic optimal control problems. Firstly, using necessary conditions for optimality, the problem is changed into a two-boundary value problem (TBVP). Next, Haar wavelets are applied for converting the TBVP, as a system of differential equations, in to a system of matrix algebraic equations...
متن کاملOptimal Control of Partially Observable Linear Quadratic Systems with Asymmetric Observation Errors
This paper deals with the optimal quadratic control problem for non-Gaussian discrete-time stochastic systems. Our main result gives explicit solutions for the optimal quadratic control problem for partially observable dynamic linear systems with asymmetric observation errors. For this purpose an asymmetric version of the Kalman filter based on asymmetric least squares estimation is used. We il...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2015